From usable to useful assessment knowledge and evaluation

In this article contrasts are made between usable and useful knowledge. Usable knowledge represents knowledge that someone finds pertinent. Useful knowledge has a function and can lead to specific action. The applications to educational assessment and evaluation are clear in that much assessment knowledge is developed at a level that is nominally usable, but provides no real guidance in the improvement of learning. Knowledge management through the measurement of social and organizational capital is suggested as a strategy to augment accountability policies based exclusively on test scores. This approach would work as a way to set targets and monitor the development of schools as an institution, responsible for performance by adults and students that extend beyond measured performance

8. Issues in Intelligent Computer-Assisted Instruction: Eval uation and Measurement

In this chapter we plan to explore two issues in the field of intelligent computer assisted instruction (ICAI) that we feel offer opportunities to advance the state of the art. These issues are evaluation of ICAI systems and the use of the underlying technology in ICAI systems to develop tests. For each issue we will provide a theoretical context, discuss key constructs, provide a brief window to the appropriate literature, suggest methodological solutions and conclude with a concrete example of the feasibility of the solution from our own research. INTELLIGENT COMPUTER-ASSISTED INSTRUCTION (ICAI) ICAI is the application of artificial intelligence to computer-assisted instruction. Artificial intelligence, a branch of computer science, is making computers smart in order to (a) make them more useful and (b) understand intelligence (Winston, 1977). Topic areas in artificial intelligence have included natural language processing (Schank, 1980), vision (Winston, 1975), knowledge representation (Woods, 1983), spoken language (Lea, 1980), planning (Hayes-Roth, 1980), and expert systems (Buchanan, 1981). The field of Artificial Intelligence (AI) has matured in both hardware and software. The most commonly used language in the field is LISP (List Processing). A major development in the hardware area is that personal LISP machines are now available at a relatively low cost (20-50K) with the power of prior mainframes. In the software area two advances stand out: (a) programming support environments such as LOOPS (Bobrow & Stefik, 1983) and (b) expert system tools. These latter tools are now running on powerful micros. The application of expert systems technology to a host of real-world problems has demonstrated the utility of artificial intelligence techniques in a very dramatic style. Expert system technology is the branch of artificial intelligence at this point most relevant to ICAI. Expert Systems Knowledge-based systems or expert systems are a collection of problem-solving computer programs containing both factual and experiential knowledge and data in a particular domain. When the knowledge embodied in the program is a result of a human expert elicitation, these systems are called expert systems. A typical expert system consists of a knowledge base, a reasoning mechanism popularly called an inference engine and a friendly user interface. The knowledge base consists of facts, concepts, and numerical data (declarative knowledge), procedures based on experience or rules of thumb (heuristics), and causal or conditional relationships (procedural knowledge). The inference engine searches or reasons with or about the knowledge base to arrive at intermediate conclusions or final results during the course of problem solving. It effectively decides when and what knowledge should be applied, applies the knowledge and determines when an acceptable solution has been found. The inference engine employs several problem-solving strategies in arriving at conclusions. Two of the popular schemes involve starting with a good description or desired solution and working backwards to the known facts or current situation (backward chaining), and starting with the current situation or known facts and working toward a goal or desired solution (forward chaining). The user interface may give the user choices (typically menu-driven) or allow the user to participate in the control of the process (mixed initiative). The interface allows the user: to describe a problem, input knowledge or data, browse through the knowledge base, pose question, review the reasoning process of the system, intervene as necessary, and control overall system operation. Successful expert systems have been developed in fields as diverse as mineral exploration (Duda & Gaschnig, 1981) and medical diagnosis (Clancy, 1981). ICAI Systems ICAI systems use approaches artificial intelligence and cognitive science to teach a range of subject matters. Representative types of subjects include: (a) collection of facts, for example, South American geography in SCHOLAR (Carbonell & Collins, 1973); (b) complete system models, for example, a ship propulsion system in STEAMER (Stevens & Steinberg, 1981) and a power supply in SOPHIE (Brown, Burton, & de Kleer, 1982); (c) completely described procedural rules, for example, strategy learning, WEST (Brown, Burton, & de Kleer, 1982), or arithmetic in BUGGY (Brown & Burton, 1978); (d) partly described procedural rules, for example, computer programming in PROUST (Johnson & Soloway, 1983); LISP Tutor (Anderson, Boyle, & Reiser, 1985); rules in ALGEBRA (McArthur, Stasz, & Hotta, 1987); diagnosis of infectious diseases in GUIDON (Clancey, 1979); and an imperfectly understood complex domain, causes of rainfall in WHY (Stevens, Collins, & Goldin, 1978). Excellent reviews by Barr and Feigenbaum (1982) and Wenger (1987) document many of these ICAI systems. Representative research in ICAI is described by O\u27Neil, Anderson, and Freeman (1986) and Wenger (1987). Although suggestive evidence has been provided by Anderson et al. (1985), few of these ICAI projects have been evaluated in any rigorous fashion. In a sense they have all been toy systems for research and demonstration. Yet, they have raised a good deal of excitement and enthusiasm about their likelihood of being effective instructional environments. With respect to cognitive science, progress has been made in the following areas: identification and analysis of misconceptions or bugs (Clement, Lockhead, & Soloway, 1980), the use of learning strategies (O\u27Neil & Spielberger, 1979; Weinstein & Mayer, 1986), expert versus novice distinction (Chi, Glaser, & Rees, 1982), the role of mental models in learning (Kieras & Bovair, 1983), and the role of self-explanations in problem solving (Chi, Bassok, Lewis, Reimann, & Glaser, 1987). The key components of an ICAI system consist of a knowledge base: that is, (a) what the student is to learn; (b) a student model, either where the student is now with respect to subject matter or how student characteristics interact with subject matters, and (c) a tutor, that is, instructional techniques for teaching the declarative or procedural knowledge. These components are described in more detail by Fletcher (1985)

Role of Diffusion Tensor Imaging in Prognostication and Treatment Monitoring in Niemann-Pick Disease Type C1

Niemann-Pick Disease, type C1 (NPC1) is a rapidly progressive neurodegenerative disorder characterized by cholesterol sequestration within late endosomes and lysosomes, for which no reliable imaging marker exists for prognostication and management. Cerebellar volume deficits are found to correlate with disease severity and diffusion tensor imaging (DTI) of the corpus callosum and brainstem, which has shown that microstructural disorganization is associated with NPC1 severity. This study investigates the utility of cerebellar DTI in clinical severity assessment. We hypothesize that cerebellar volume, fractional anisotropy (FA) and mean diffusivity (MD) negatively correlate with NIH NPC neurological severity score (NNSS) and motor severity subscores. Magnetic resonance imaging (MRI) was obtained for thirty-nine NPC1 subjects, ages 1–21.9 years (mean = 11.1, SD = 6.1). Using an atlas-based automated approach, the cerebellum of each patient was measured for FA, MD and volume. Additionally, each patient was given an NNSS. Decreased cerebellar FA and volume, and elevated MD correlate with higher NNSS. The cognition subscore and motor subscores for eye movement, ambulation, speech, swallowing, and fine motor skills were also statistically significant. Microstructural disorganization negatively correlated with motor severity in subjects. Additionally, Miglustat therapy correlated with lower severity scores across ranges of FA, MD and volume in all regions except the inferior peduncle, where a paradoxical effect was observed at high FA values. These findings suggest that DTI is a promising prognostication tool

Molecular Gas in NUclei of GAlaxies (NUGA) III. The warped LINER NGC3718

16 pages, 17 figures.-- Published in: A&A 442, 479-493 (2005), publisher version available at: http://dx.doi.org/10.1051/0004-6361:20041731.We present the first interferometric observations of CO(1–0) and CO(2–1) line emission from the warped LINER NGC 3718, obtained with the IRAM Plateau de Bure Interferometer (PdBI). This L1.9 galaxy has a prominent dust lane and on kiloparsec scales, a strongly warped atomic and molecular gas disk. The molecular gas is closely associated with the dust lane across the nucleus and its kinematic center is consistent with the millimeter continuum AGN. A comparison of our interferometric mosaic data, which fully cover the ~ 9 kpc warped disk, with a previously obtained IRAM 30m single dish CO(1–0) map shows that the molecular gas distribution in the disk is heavily resolved by the PdBI map. On the nucleus the interferometric maps alone contain less than one half of the single dish line flux, and the overall mosaic accounts for about a tenth of the total molecular gas mass of ~ 2.4 × 108M⊙. After applying a short-spacing correction with the IRAM 30m data to recover the missing extended flux, we find in total six main source components within the dust lane: one associated with the nucleus, four symmetrically positioned on either side at galactocentric distances of about 1.3 kpc and 4.0 kpc from the center, and a sixth on the western side at ~ 3 kpc with only a very weak eastern counterpart. In the framework of a kinematic model using tilted rings, we interpret the five symmetric source components as locations of strong orbital crowding. We further find indications that the warp appears not only on kpc scales, but continues down to ~ 250 pc. Besides the sixth feature on the western side, the lower flux (a factor of ~ 2) of the eastern components compared to the western ones indicates an intrinsic large scale asymmetry in NGC 3718 that cannot be explained by the warp. Indications for a small scale asymmetry are also seen in the central 600 pc. These asymmetries might be evidence for a tidal interaction with a companion galaxy (large scales) and gas accretion onto the nucleus (small scales). Our study of NGC 3718 is part of the NUclei of GAlaxies (NUGA) project that aims at investigating the different processes of gas accretion onto Active Galactic Nuclei (AGN).The research presented in this paper has been financially supported in part by the SFB 494. Stéphane Léon is partially supported by DGI Grant AYA 2002-03338 and Junta de Andalucía.Peer reviewe

Prediction of 7-year psychopathology from mother-infant joint attention behaviours: a nested case–control study

<br>Background: To investigate whether later diagnosis of psychiatric disorder can be predicted from analysis of mother-infant joint attention (JA) behaviours in social-communicative interaction at 12 months.</br> <br>Method: Using data from a large contemporary birth cohort, we examined 159 videos of a mother-infant interaction for joint attention behaviour when children were aged one year, sampled from within the Avon Longitudinal Study of Parents and Children (ALSPAC) cohort. Fifty-three of the videos involved infants who were later considered to have a psychiatric disorder at seven years and 106 were same aged controls. Psychopathologies included in the case group were disruptive behaviour disorders, oppositional-conduct disorder, attention-deficit/hyperactivity disorder, pervasive development disorder, anxiety and depressive disorders. Psychiatric diagnoses were obtained using the Development and Wellbeing Assessment when the children were seven years old.</br> <br>Results: None of the three JA behaviours (shared look rate, shared attention rate and shared attention intensity) showed a significant association with the primary outcome of case–control status. Only shared look rate predicted any of the exploratory sub-diagnosis outcomes and was found to be positively associated with later oppositional-conduct disorders (OR [95% CI]: 1.5 [1.0, 2.3]; p = 0.041).</br><br>Conclusions: JA behaviours did not, in general, predict later psychopathology. However, shared look was positively associated with later oppositional-conduct disorders. This suggests that some features of JA may be early markers of later psychopathology. Further investigation will be required to determine whether any JA behaviours can be used to screen for families in need of intervention.</br&gt

Early and Middle Holocene Hunter-Gatherer Occupations in Western Amazonia: The Hidden Shell Middens

We report on previously unknown early archaeological sites in the Bolivian lowlands, demonstrating for the first time early and middle Holocene human presence in western Amazonia. Multidisciplinary research in forest islands situated in seasonally-inundated savannahs has revealed stratified shell middens produced by human foragers as early as 10,000 years ago, making them the oldest archaeological sites in the region. The absence of stone resources and partial burial by recent alluvial sediments has meant that these kinds of deposits have, until now, remained unidentified. We conducted core sampling, archaeological excavations and an interdisciplinary study of the stratigraphy and recovered materials from three shell midden mounds. Based on multiple lines of evidence, including radiocarbon dating, sedimentary proxies (elements, steroids and black carbon), micromorphology and faunal analysis, we demonstrate the anthropogenic origin and antiquity of these sites. In a tropical and geomorphologically active landscape often considered challenging both for early human occupation and for the preservation of hunter-gatherer sites, the newly discovered shell middens provide evidence for early to middle Holocene occupation and illustrate the potential for identifying and interpreting early open-air archaeological sites in western Amazonia. The existence of early hunter-gatherer sites in the Bolivian lowlands sheds new light on the region's past and offers a new context within which the late Holocene "Earthmovers" of the Llanos de Moxos could have emerged. © 2013 Lombardo et al

Measurement of psychological entitlement in 28 countries

This article presents the cross-cultural validation of the Entitlement Attitudes Questionnaire, a tool designed to measure three facets of psychological entitlement: active, passive, and revenge entitlement. Active entitlement was defined as the tendency to protect individual rights based on self-worthiness. Passive entitlement was defined as the belief in obligations to and expectations toward other people and institutions for the fulfillment of the individual’s needs. Revenge entitlement was defined as the tendency to protect one’s individual rights when violated by others and the tendency to reciprocate insults. The 15-item EAQ was validated in a series of three studies: the first one on a general Polish sample (N = 1,900), the second one on a sample of Polish students (N = 199), and the third one on student samples from 28 countries (N = 5,979). A three-factor solution was confirmed across all samples. Examination of measurement equivalence indicated partial metric invariance of EAQ for all national samples. Discriminant and convergent validity of the EAQ was also confirmed

TIA-1 Cytotoxic Granule-Associated RNA Binding Protein Improves the Prognostic Performance of CD8 in Mismatch Repair-Proficient Colorectal Cancer

Evidence suggests a confounding effect of mismatch repair (MMR) status on immune response in colorectal cancer. The identification of innate and adaptive immune cells, that can complement the established prognostic effect of CD8 in MMR-proficient colorectal cancers patients, representing 85% of all cases, has not been performed

Physicochemical and sensorial properties of grapefruit jams as affected by processing

Jam is an effective and tasty way of preserving fruit. Jam processing procedures as well as storage conditions and duration are important factors for jam quality. Traditional jam processing involves the application of severe thermal treatments that imply undesirable changes in the product quality characteristics such as colour, texture, flavour and nutritional and functional value. In this work, osmotic dehydration (OD) and/or microwave energy (MW) was proven as adequate to obtain jam with the typical characteristics of water content, degree Brix, pH and water activity of jam obtained by conventional thermal heating. The sensory evaluation carried out to compare the product showed that samples submitted to more intense heating treatments (conventional or MW) had significantly higher scores in colour saturation, brightness, grapefruit taste and extensibility than OD or OD+MW ones. As deduced from the obtained results, OD treatment prevents grapefruit colour changes, and mild MW heating contributes to increase the consistency and decrease the extensibility of the obtained jam. In this way, OD+MW jam was preferred by assessors mainly due to its higher consistency. The sample obtained by this procedure was stable during storage.The authors would like to thank the Ministerio de Educacion y Ciencia for the financial support given throughout the Project AGL 2005-05994. The language revision of this paper was funded by the Universidad Politecnica de Valencia, Spain.Igual Ramo, M.; García Martínez, EM.; Camacho Vidal, MM.; Martínez Navarrete, N. (2013). Physicochemical and sensorial properties of grapefruit jams as affected by processing. Food and Bioprocess Technology. 6(1):177-185. https://doi.org/10.1007/s11947-011-0696-2S17718561AENOR (2009). Sensory analysis. Methodology. Paired comparison test. UNE-EN-ISO 5495.AOAC. (2000). Official methods of analysis of AOAC International (17th ed.). Gaithersburg: AOAC International.Baker, R.-A., Berry, N., Hui, Y.-H., & Barrett, D.-M. (2005). Fruit preserves and jams. In Processing fruits: science and technology (2nd ed., pp. 113–125). Boca Ratón: CRC Press.Bodart, M., de Peñaranda, R., Deneyer, A., & Flamant, G. (2008). Photometry and colorimetry characterisation of materials in daylighting evaluation tools. Building and Environment, 43, 2046–2058.BOE (1990). Real Decreto 670/1990, de 25 de mayo, por el que se aprueba la norma de calidad para confituras, jaleas y marmalade de frutas, crema de castañas y mermelada de frutas. BOE Nº 130 (31/5/1990), 15140–15144.Bourne, M. (1982). Food texture and viscosity—concept and measurement. New York: Academic.Cañumir, J.-A., Celis, J.-E., Brujin, J., & Vidal, L. (2002). Pasteurisation of apple juice by using microwaves. Lebensmittel-Wissenschaft und Technologie, 35, 389–392.Contreras, C., Martín-Esparza, M.-E., Martínez-Navarrete, N., & Chiralt, A. (2008). Influence of microwave application on convective drying: effects on drying kinetics, and optical and mechanical properties of apple and strawberry. Journal of Food Engineering, 88, 55–64.Dervisi, P., Lamb, J., & Zabetakis, I. (2001). High pressure processing in jam manufacture: effects on textural and color properties. Food Chemistry, 73, 85–91.Deyhim, F., Garica, K., Lopez, E., Gonzalez, J., Ino, S., Garcia, M., et al. (2006). Citrus juice modulates bone strength in male senescent rat model of osteoporosis. Nutrition, 22(5), 559–563.García-Martínez, E., Ruiz-Diaz, G., Martínez-Monzó, J., Camacho, M.-M., Martínez-Navarrete, N., & Chiralt, A. (2002). Jam manufacture with osmodehydrated fruit. Food Research International, 35, 301–306.Igual, M., García-Martínez, E., Camacho, M.-M., & Martínez-Navarrete, N. (2010a). Effect of thermal treatment and storage on the stability of organic acids and the functional value of grapefruit juice. Food Chemistry, 118, 291–299.Igual, M., Contreras, C., & Martínez-Navarrete, N. (2010b). Non-conventional techniques to obtain grapefruit jam. Innovative Food Science and Emerging Technologies, 11(2), 335–341.Meilgaard, M., Civille, G.-V., & Carr, B.-T. (1999). Attribute differences test. Pairwise ranking test: Friedman analysis. Sensory evaluation techniques (pp. 103–106). Boca Ratón: CRC Press.Moraga, M.-J., Moraga, G., Fito, P. J., & Martínez-Navarrete, N. (2009). Effect of vacuum impregnation with calcium lactate on the osmotic dehydration kinetics and quality of osmodehydrated grapefruit. Journal of Food Engineering, 90, 372–379.Nikdel, S., Chen, C., Parish, M., MacKellar, D., & Friedrich, L. (1993). Pasteurization of citrus juice with microwaves energy in a continuous-flow unit. Journal of Agricultural and Food Chemistry, 41, 2116–2119.Poulose, S.-M., Harris, E.-D., & Patil, B.-S. (2005). Citrus limonoids induce apoptosis in human neuroblastoma cells and have radical scavenging activity. Journal of Nutrition, 135, 870–877.Sanchez-Moreno, C., Plaza, L., De Ancos, B., & Cano, M.-P. (2003). Quantitative bioactive compounds assessment and their relative contribution to the antioxidant capacity of commercial orange juices. Journal of the Science of Food and Agriculture, 83, 430–439.Shi, X.-Q., Chiralt, A., Fito, P., Serra, J., Escoin, C., & Gasque, L. (1996). Application of osmotic dehydration technology on jam processing. Drying Technology, 14(3&4), 841–857.Tárrega, A., & Costell, E. (2007). Colour and consistency of semi-solid dairy desserts: instrumental and sensory measurements. Journal of Food Engineering, 78, 655–661.Vanamala, J., Reddivari, L., Yoo, K.-S., Pike, L.-M., & Patil, B.-S. (2006). Variation in the content of bioactive flavonoid in different brands of orange and grapefruit juices. Journal of Food Composition and Analysis, 19(2–3), 157–166.Wicklund, T., Rosenfeld, H.-J., Martinsen, B.-K., Sundførb, M.-W., Lea, P., Bruun, T., et al. (2005). Antioxidant capacity and colour of strawberry jam as influenced by cultivar and storage conditions. LWT-Food Science and Technology, 38(4), 387–391.Yu, L.-L., Zhou, K.-K., & Parry, J. (2005). Antioxidant properties of cold-pressed black caraway, carrot, cranberry, and hemp seed oils. Food Chemistry, 91, 723–729

Investigation of the international comparability of population-based routine hospital data set derived comorbidity scores for patients with lung cancer

Introduction: The International Cancer Benchmarking Partnership (ICBP) identified significant international differences in lung cancer survival. Differing levels of comorbid disease across ICBP countries has been suggested as a potential explanation of this variation but, to date, no studies have quantified its impact. This study investigated whether comparable, robust comorbidity scores can be derived from the different routine population-based cancer data sets available in the ICBP jurisdictions and, if so, use them to quantify international variation in comorbidity and determine its influence on outcome. Methods: Linked population-based lung cancer registry and hospital discharge data sets were acquired from nine ICBP jurisdictions in Australia, Canada, Norway and the UK providing a study population of 233 981 individuals. For each person in this cohort Charlson, Elixhauser and inpatient bed day Comorbidity Scores were derived relating to the 4–36 months prior to their lung cancer diagnosis. The scores were then compared to assess their validity and feasibility of use in international survival comparisons. Results: It was feasible to generate the three comorbidity scores for each jurisdiction, which were found to have good content, face and concurrent validity. Predictive validity was limited and there was evidence that the reliability was questionable. Conclusion: The results presented here indicate that interjurisdictional comparability of recorded comorbidity was limited due to probable differences in coding and hospital admission practices in each area. Before the contribution of comorbidity on international differences in cancer survival can be investigated an internationally harmonised comorbidity index is required